Original Research
Evaluation of management information systems: A study at a further education and training college
Submitted: 25 July 2012 | Published: 15 March 2013
About the author(s)
Mariette Visser, Human Sciences Research Council (HSRC), Pretoria, South AfricaJudy van Biljon, School of Computing, College of Science, Engineering and Technology, University of South Africa, South Africa
Marlien Herselman, Council for Scientific and Industrial Research (CSIR), Pretoria, South Africa
Abstract
Objectives: The main objective was to propose a MIS evaluation model and evaluation tool(questionnaire), and verify the model empirically by evaluating the MIS at a selected FET college. The supporting objectives were firstly, to identify the most appropriate MIS evaluation models from literature. Secondly, to propose a MIS evaluation model for FET colleges based on the literature. Thirdly, to develop the evaluation tool (questionnaire) based on these models. Fourthly, to capture and analyse data from one FET college, in order to evaluate the performance of the MIS at the college. The final supporting objective was to evaluate the proposed model by triangulating the findings from the survey with the findings from the interviews.
Method: The proposed MIS evaluation model is based on the integration of three existing MIS evaluation models. The evaluation tool was developed by combining four empirically tested questionnaires that capture the constructs in the underlying models. A survey and semi-structured interviews were used as data collection methods. The statistical tests for consistency, scale reliability (Cronbach’s alpha) and unidimensionality (Principal Component Analysis) were applied to explore the constructs in the model.
Results: Results from the empirical testing of the newly designed evaluation tool were used to refine the initial model. The qualitative data capturing and analysis added value in explaining and contextualising the quantitative findings.
Conclusion: The main contribution is the SA-FETMIS success model and evaluation tool which managers can use to evaluate the MIS at an educational institution. The novelty of the research lies in using a mixed methods approach where previous MIS success evaluation studies mainly used quantitative methods.
Keywords
Metrics
Total abstract views: 21217Total article views: 29974
Crossref Citations
1. Evaluating Representativeness of Qualitative Text Data in Identifying UX Issues
Ye Lim Rhie, Ji Hyoun Lim, Myung Hwan Yun
International Journal of Human–Computer Interaction vol: 33 issue: 11 first page: 868 year: 2017
doi: 10.1080/10447318.2017.1294337